Estimating Vaccine Effectiveness by Linking Population-Based Health Registries: Some Sources of Bias.

The coronavirus disease 2019 (COVID-19) pandemic has underscored the importance of observational studies of real-world vaccine effectiveness (VE) to help answer urgent public health questions. One approach to rapidly answering questions about real-world VE relies on linking data from a population-based registry of vaccinations with a population-based registry of health outcomes. Here we consider some potential sources of bias in linked registry studies, including incomplete reporting to the registries, errors in linking individuals between registries, and errors in the assumed population size of the catchment area of the registries. We show that the direction of the bias resulting from one source of error by itself is predictable. However, if multiple sources of error are present, the direction of the bias can be either upward or downward. The biases can be so strong as to make harmful vaccines appear effective. We provide explicit formulas with which to quantify and adjust for multiple biases in estimates of VE which could be used in sensitivity analyses. While this work was motivated by COVID-19 vaccine questions, the results are generally applicable to studies that link population-based exposure registries with population-based case registries to estimate relative risks of exposures.

Excess Patient Visits for Cough and Pulmonary Disease at a Large US Health System in the Months Prior to the COVID-19 Pandemic: Time-Series Analysis.

BACKGROUND: Accurately assessing the regional activity of diseases such as COVID-19 is important in guiding public health interventions. Leveraging electronic health records (EHRs) to monitor outpatient clinical encounters may lead to the identification of emerging outbreaks. OBJECTIVE: The aim of this study is to investigate whether excess visits where the word "cough" was present in the EHR reason for visit, and hospitalizations with acute respiratory failure were more frequent from December 2019 to February 2020 compared with the preceding 5 years. METHODS: A retrospective observational cohort was identified from a large US health system with 3 hospitals, over 180 clinics, and 2.5 million patient encounters annually. Data from patient encounters from July 1, 2014, to February 29, 2020, were included. Seasonal autoregressive integrated moving average (SARIMA) time-series models were used to evaluate if the observed winter 2019/2020 rates were higher than the forecast 95% prediction intervals. The estimated excess number of visits and hospitalizations in winter 2019/2020 were calculated compared to previous seasons. RESULTS: The percentage of patients presenting with an EHR reason for visit containing the word "cough" to clinics exceeded the 95% prediction interval the week of December 22, 2019, and was consistently above the 95% prediction interval all 10 weeks through the end of February 2020. Similar trends were noted for emergency department visits and hospitalizations starting December 22, 2019, where observed data exceeded the 95% prediction interval in 6 and 7 of the 10 weeks, respectively. The estimated excess over the 3-month 2019/2020 winter season, obtained by either subtracting the maximum or subtracting the average of the five previous seasons from the current season, was 1.6 or 2.0 excess visits for cough per 1000 outpatient visits, 11.0 or 19.2 excess visits for cough per 1000 emergency department visits, and 21.4 or 39.1 excess visits per 1000 hospitalizations with acute respiratory failure, respectively. The total numbers of excess cases above the 95% predicted forecast interval were 168 cases in the outpatient clinics, 56 cases for the emergency department, and 18 hospitalized with acute respiratory failure. CONCLUSIONS: A significantly higher number of patients with respiratory complaints and diseases starting in late December 2019 and continuing through February 2020 suggests community spread of SARS-CoV-2 prior to established clinical awareness and testing capabilities. This provides a case example of how health system analytics combined with EHR data can provide powerful and agile tools for identifying when future trends in patient populations are outside of the expected ranges.